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Two-Phase Method - Why do we need it? 





If the all constraints of the given LPP has < sign for the 
comparison, then introduction of slack variables will not create any 
hurdles in order to choose a basis for obtaining the initial basic 
feasible solution (BFS). So, we may easily choose a basis for 
obtaining initial BFS in this case. 


But, if it involves other signs for comparison, say for example > 
constraints, the introduction of surplus variables might create some 
hindrances to choose the initial BFS. Two-phase method helps 
us to choose a basis to obtain the initial BFS in such cases. 


How to use Two-Phase Method? 





ə Phase 1 


e Change the given LPP into standard form so that simplex 
method can be used. 

e Now, to each of the constraints, add a variable. That is to say 
if a constraint is, for example, 2x + Зу = 5, make it 
2x + 3y + A = 5. Such a variable A is called an artificial 
variable, which is necessarily non-negative. 

e Introduce the objective function w = A; + A» +... + Ар, 
where each of the A's are artificial variables. 

e We now try to minimize w subjected to the new constraints 
we obtained by adding the artificial variables, using the 
usual simplex method. Apply row operations to the row that 
represents original objective function as well, for easier 
computations. 





e The following cases may arise. 


e The objective function w has been minimized with a 
positive value and the artificial variables are in the basis at 
a positive level (that is, with a non-zero value). This 
means the given LPP has no solution. 

e The objective function w has been minimized with 
Wmin = О and the artificial variables are not in the basis. 
This means an initial BFS has been obtained. 

e The objective function w has been minimized with 
Wmin = О and the artificial variables are in the basis at a 
zero level (that is, with a zero value). This means an initial 
BFS has been obtained. 


e We enter Phase-2 if one of the latter cases are obtained. 





ә Phase-2 

e |f the second case is obtained at the end of Phase-1, then 
remove all the rows and columns concerned with the artificial 
variables and artificial objective function w, from the final 
tableau of Phase-1. The remaining parts of the table form the 
initial tableau for the optimization procedure that we shall 
proceed with. Apply usual simplex method to solve the 
problem. 

e If the third case is obtained, we delete only those artificial 
variables which are not in the basis. Then, we apply the usual 
simplex method. If the artificial variables are at zero-level, in 
every iteration, then no hindrances shall be there. But what if 
artificial variables are at a positive-level in some iteration? In 
such a case, we DO NOT use the minimum ratio test to 
determine which variable leaves the basis. We simply remove 
the artificial variable from the basis. Then, applying simplex 
algorithm in the usual manner will help us optimize z, if 
possible. 


Example 1 





The following table shows the final table of Phase-1 of some given 
LPP. The symbols carry their usual meanings. The actual 
calculations are not made. Just a hypothetical example for a quick 
explanation. This shall be same for the examples that follow. 





























vo | A A» Аз | хі X» X3 x X В 

z— |-25 1 1 -1.5 0 -15 0 0145 
EV as w —> | -1 -1 -1 0 оо 000 
Xo n/a 0.5 0 0 15 1 05 0 010.5 
X4 n/a -0.5 1 0 35 0 05 0 0 | 1.5 
X5 n/a -25 0 1 55 0 -15 0 1 115 








(Case 2 of final iteration of Phase-1) 
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Example 2 

















v | А: Ao Аз ж № x3 X4 х5 В 
z= |-2.5 0 1 0 0 15 0 0 4 
Ey м > | -1 0 -1 0 0 0 -3 0 0 
xı n/a 0.5 0 0 1 8 05 0 0 3 
A» n/a -0.5 1 0 0 5 05 0 0 0 
X4 n/a -25 0 1 0 9 -15 1 1/5 























(Case 3 of final iteration of Phase-1) 


Example 3 

















v> Ам ж x3 | b 
2105 -3 0 4 5 

e: w|0.-2-40 0 |1 
A n/a 11/8 5 0 0 |1 
X3 п/а 016 4 1 943 























(Case 1 of final iteration of Phase-1) 


t Theorem Minimization of Distance - А Theorem оп 


Existence and Uniqueness 









Let S be a non-empty closed convex set in R” and let y ¢ S. Then 
there exists a unique point xy in S at a minimum distance from y. 


The Proof of first theorem - Part 1 : Existence 





ə As S is non-empty, we have Z € S. As y ¢ S, for every such 
2, |y — Z|| Z 0, giving us |У — Z|| > 0. This represents the 
distance between y and any point Z in S. We are to show the 
existence of a point in S which is at a minimum distance from 
7. . 

e Take a fixed К in S. Consider a set 
Sı = Sn(X ER": |y — Х| < |17 — |}. S is closed and the 
other set in the definition of $1 is a closed ball with radius 
lY — | and center at y, which makes it closed. So, 51 is a 
closed set, being an intersection of two closed sets. Also, $1 is 
a subset of a closed ball, which is bounded. Hence, $1 is 
bounded. This shows $1 is closed and bounded, that is, $1 is 
compact. 





e Here is the main trick of the proof. We are to find the 
infimum of [у — x||, where X is a point in S. Furthermore, we 
need to show that the infimum is due to a point, say xo, in S, 
so that we can say ||y — xo|| is the minimum distance between 
a fixed y @ S, and a point in S. We do it by obtaining such а 
point in $1. 

ə Let us a define a function f on Sı with codomain R by 
f(x) = |y — x||, for every X in S1. This function is а 
continuous function. Also, $1 is a compact set in the metric 
space (R^, ||3 — b||). So, we must have a point хо in Sı such 
that f(x5) = |У — xo|| is the minimum value of the function. 





e Now let us look back at the definition of $1. It is a collection 
of points in 5, whose distance is less than or same as ||y — (|. 
But, |17 — k|| is a distance between a point in S and у. If there 
existed no points other than K, it would have been minimum. 
Otherwise, we would've confirmed the existence of other such 
points. It doesn't matter if we take consideration of how large 
|У— K|| is, we just need this value, or possibly some other 
value given by some point in S, which is less than this value. 


e We have already found that there is a point in S1, and hence 
in S, which gives the minimum value of ||y — x|| (x € S) 
whenever it is less than or same as |7 — K||. If there are any 
other points X in S, with the property that || — x|| > ||y — |, 
the same point хо will work. Hence we have found a point xo 
in S, such that the distance between xj and y is minimum. 


The Proof of first theorem - Part 2 : Uniqueness 





e To show uniqueness of the point of minimum distance, assume 
the contrary. So there are two distinct points ид and wo in S 
such that both of them give the minimum value, which is 





unique. As S is a convex set, we must have mom in S. 
e We have, 
Wi + ИР - p. cs 4 - 1 5 = E = 
1227 = zia evo - 27 < 5-1 +1 91). 





e Due to uniqueness of minimum value, we have, 
|m — 711 = || wo — У]. This gives, 


и Б Мо ., 5 2, 
1—5 < Iv – yl. 


e |f < holds, then it is a contradiction since the definition of 
minimum is being violated. If we assume that = holds, then 
we again arrive at a contradiction since, we must have the 
following existence 





NER: y— № = A( — WA). 





On taking norm, we get А = +1, which either contradicts the 
assumption of ид Z Wo or that of y ¢ S. Hence, the 
uniqueness is guaranteed. 


id Theorem on Minimization of Distance - A Theorem 


on Characterization 










Let S be а non-empty and closed convex set and let y ¢ S. Then, 
хо is a minimizing point iff (y — x9) (X — xo) < 0, for all x € S. 


The proof of second theorem - = part 





ә Let хо be the minimizing point. Then, for all x € S, 

lY — xol? € 17 — ХР. 
ə As X, xo € S, and as S is convex, 
AX + (1 — A)xo = xo + A(X — xo) is in S (0 € A «€ 1). 
Replacing X by this point in the inequality, we get, X € $5, 
[У — Х|? € |l — xo А). 


© 


© 


By definition of a dot product, we have the RHS of this 
inequality as || — 2? + || — xl? — 2AF — x6). (X — xb). 








e Combining the last two inequalities, we get, 
2X(y — xo)! (X — xo) € A*||X — xol? 

e ЕЛ = 0, then the point obtained convex combination is 
simply хо and the inequality holds trivially. So let A > 0. 
Dividing the above inequality by A in this case and taking 
limits as Л — 0*, we get the required inequality. 


The proof of second theorem - < part 





0, for all x € S. This means 


Let (y 3) (X $) < 
— xo) > 0, for all x € S. We have, for all x in S, 


(хо — X) ( 
7X? = 17—602 = |17021 12-200) (Уж) 
which gives, for all X in S, 

lY — xl = 17 — <]. 


Hence, хо is the minimizing point. 
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